VALEVAL: Testing Vallex Consistency and Experimenting with Word-Frame Disambiguation

VALLEX is a valency lexicon of Czech verbs. We briefly introduce VALLEX and then describe and evaluate the VALEVAL experiment: annotation of 10256 corpus instances of 109 Czech verbs with valency frames. The inter-annotator agreement of three parallel annotations ranges from 61% to 74% and κ from 0.52 to 0.62. More than 8000 sentences are now available as the “golden VALEVAL” for word-sense disambiguation experiments. In out first attempts using morphological and syntax-based information, we achieve the accuracy of 70% to 80%.